RANKS OF TENSORS AND AND A GENERALIZATION OF SECANT 

VARIETIES 
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Abstract. We investigate differences between X-rank and X-border rank, focusing on the 
cases of tensors and partially symmetric tensors. As an aid to our study, and as an object of 
interest in its own right, we define notions of X-rank and border rank for a linear subspace. 
Results include determining and bounding the maximum X-rank of points in several cases of 
interest. 



1. Introduction 

A central problem in many areas (signal processing, algebraic statistics, complexity theory 
etc., see e.g., [4, 8, 23, 18]) is to understand the ranks and border ranks of 3-way tensors. Let 
A, B, C be complex vector spaces of dimensions a, b, c, and let p G A(^B(^C. One would like to 
express p as a sum of decomposable tensors, just as one diagonalizes matrices in order to study 
them better. A first question is to determine how many decomposable tensors one needs. This 
question has been answered for generic p and most (a, b, c), see [1] for the state of the art. The 
next question is what is the maximum number of decomposable tensors needed for an arbitrary 
p, and this question is wide open. One would also like to have normal forms when possible, and 
to have tests to see if p can be written as a sum of say r decomposable elements, just as a matrix 
is the sum of r rank one matrices if all its (r + 1) x (r + 1) minors vanish. Strassen [24] had 
the idea to reduce this problem to the study of linear subspaces of spaces of endomorphisms, 
by considering p G A(^B^C as a linear map A* — t- B®C and studying the image. Strassen's 
famous equations for a^{Seg(¥'^ x P" x P")) are exactly the expression that, after fixing an 
identification C ~ B* so the image may be thought of as a space of endomorphisms, is that the 
endomorphisms commute (see [4, 21] for discussions). 

In this paper we exploit Strassen's perspective further and generalize it. We determine the 
possible ranks of 3-way tensors having a given border rank in several cases. In a different 
direction, we generalize the perspective by studying X-ranks and border ranks of points on 
varieties of the form X = Seg{¥A x y) C P(^(8>H^), where Y C PVF is a projective variety, via 
a generalized notion of rank and border rank for linear subspaces of W . The special cases where 
y is a Veronese variety or Grassmannian arise in applications (see e.g., [25, 7]). 

Comparing rank and border rank has been a topic of recent interest, see for example [8, 7, 9, 
6, 2, 22, 13, 12]. 

1.1. Definitions. Let Ai, ... ,Ak be complex vector spaces and let SegiFAi x • • • x PAjt) C 
P(^i(8) • • • (g) Afc) denote the Segre variety of decomposable tensors in Ai®---®Ak. Given 
a tensor p € Ai® ■ ■ ■ ® A^.^ define the rank (resp. border rank) Rseg{¥Aix---y.¥Ak){[p\) (resp. 
^5eg(Pylix---xPAfc)([p])) P to be the smallest r such that there exist 

[a\<^ • • • (g) 4], . . . , [a\® ■■■®al]e Seg{¥Ai x • • • x P^^) 
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with a J G Aj such that p = a}® • • • (8) + • • • + aj® • • • (8) (resp. that there exist curves 

aj{t) C Aj such that \p] = limt-^.o[a];(t)(8) • • • (g) a^(t) H h a]^(t)(8) • • • (g) a^(t)]). Sometimes this 

is called the tensor (border) rank. These definitions agree with the definitions in the tensor 
literature. 

More generally, for a projective variety X C FV, the X-rank of [p] G FV, Rx{\p\), is defined 

to be the smallest r such that there exist Xi, . . . ,Xr & X such that p is in the span of xi, . . . , 

and the X-border rank Rx([p]) is defined similarly. 

We generalize the notion of the X-rank and border rank of a point to a linear subspace: 
Let F = C", let FV denote the associated projective space and let G{k,V) denote the Grass- 

mannian of fc-planes through the origin in V (equivalently, the set of P'^~"^'s in FV). For a subset 

Z C FV, let {Z) C V denote its linear span. 

Definition 1.1. For a variety X C FV, and E G G{k,V), define Rx{E), the X-rank of E 
to be the smallest r, such that there exists xi,...,Xr G X and E C {xi, . . . ,Xr). Define 
a^f^{X) c G{k, W) to be the set of A;-planes of X-rank at most r, and let crr,fc(X) c G{k, W) 
denote its Zariski closure. When = 1 we write ar,\{X) = ar{X) C FV for the r-th secant 
variety of X. Our notation is such that cri{X) = X. 

1.2. Overview. In §2 we revisit two standard results on ranks of tensors to generalize and 
strengthen them (Theorems 2.1 and 2.4). In §3 we establish basic properties about the vari- 
eties ar,k{X) and X-ranks of linear spaces. We briefly mention in §4 a few cases where ranks 
and border ranks of tensors agree. In §5 we revisit work of Ja'Ja' [12] on ranks of tensors in 
C^(8)C'^(8)C*^. When b < 3 we describe normal forms for such tensors, explicitly determine their 
ranks, and give geometric interpretations for the points of a given normal form. In §6 we apply 
earlier results to the case of partially symmetric tensors, illustrating the utility of the definition 
of the X-rank of a linear space. We conclude, in §7 by describing normal forms for points in the 
third secant variety of a Segre variety, and determining or bounding the ranks of such points. 

1.3. Acknowledgement. We thank J. Weyman and M. Mohlenkamp for pointing out errors 
in an earlier version of this article, specifically they respectively pointed out there were orbits 
missing in the list in §5 and that the rank of y + y' + y" in Proposition 7.1 is 5. This paper 
grew out of questions raised at the 2008 AIM workshop Geometry and representation theory of 
tensors for computer science, statistics and other areas, and the authors thank AIM and the 
conference participants for inspiration. 

2. Generalizations of standard results on ranks of Segre products 

Let Y C FW be a variety and let X = Seg{FA x Y) C F{A®W) be the Segre product of Y 
with the projective space FA. 

Theorem 2.1. Let A' C A be a linear subspace and let p G F{A''SiW). Then any expression 

p=[vi-\ \-Vs] such that some [vj] ^ X n F{A'(S)W) has s > Rx{p)- 

For any expression p = limt^o[vi{t) -|- • • • -|- Vs{t)] with Vj{t) G X tiiere exist wi{t), . . . ,Ws{t), 

such that p = limt^o[wi{t) -i h Ws{t)] with Wj{t) G X n F{A' W). 

In particular Rx\¥{A'^W) = Rxn¥{A'^w) Rx|p(A'®VK) = S:XnP(^'®W)- 
Theorem 2.1 recovers and strengthens (the "moreover" statement below) the following stan- 
dard fact (e.g., [4, Prop. 14.35], [9, Prop. 3.1]): 

Corollary 2.2. Let n > 2. Let T e Aiig) • • ■ 8) A„ have rank r. Say T G A[(^ •••(g) A'^, where 
Aj C Aj, with at least one inclusion proper. Then any expression 

some u^j ^ A'^ has p>r. In particular Rseg{FAix-xFAr,)(T) = Rseg{FA[x-xVA'j{T)- Moreover 
B:5efl(PAix-xPA„)(^) = BiSeg{FA[x-xWA'j{T)- 
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Proof of Theorem 2.1. Choose a complement A" c ^ to ^4' so that A = A' ® A". 

To prove the assertion regarding rank, write p = vi-\ \-Vs, where Vj = aj®yj with yj £Y. 

Write aj = bj + cj with bj G A' and Cj € A" . Since p € A'^W, we have ^ Cj^yj = 0. Let {ej} 
be a basis of A" . We have Cj = ^jet so ^jyj = for all t. Say e.g., ^ 0, then we can write 
ys as a linear combination of i/i, . . . , ys-\ and obtain an expression of rank s — 1. 

To prove the border rank assertion, for each = aj{t)^yj{t) write aj{t) = bj{t) + Cj{t) 

with bj{t) C A' and Cj{t) C A". Also write p{t) := so that [p] = limt_^o • Since 

hence the claim holds. □ 

The following bound on rank (in the three factor case) appears in [4, Prop. 14.45] as an 
inequality, where it is said to be classical, and as an equality in [10, Thm 2.4]. It is also used 
e.g., in [12]: 

Proposition 2.3. Let (j) G Ai® ■ ■ ■ (S> An, Then R{(/)) equals the number of points of Seg{FA2 x 
• • • X ¥An) needed to span <p{Al) C ^2*^ • • • ^ An (and similarly for the permuted statements). 

Here is a generalization and strengthening (the border rank assertion) of Proposition 2.3: 
Theorem 2.4. LetY C ¥W andletX := Seg{¥AxY). Givenpe A(S)W , Rxi\p]) = RyipiA*)) 
and Rx(b]) = B:y(p(^*))> where on the right hand sides of the equations we have interpreted 
p as a linear map: p : A* ^W. 

Proof. We prove the border rank statement, the rank statement is the special case where each 
curve is constant. 

To see Rx([p]) > Ry(p(^*)), assume Rx([p]) = r and write 

p{t) = ai{t) ® yi(t) H h ar{t) ® yr{t) 

where ai{t) G A and yi{t) G Y and 

[p] = lim[p(i)]. 

li A' (Z A is such that [p] G f{A' ® W), then by Theorem 2.1 we may assume 

p{t) eA'®W and ai{t) G A'. 

Replacing A by a smaller vector space if necessary, we may assume pit) : A* ^ W \s injective 
for all values of t sufficiently close to 0. Thus the image of p{t) : A* ^ W determines a curve 
in in the appropriate Grassmannian and the limiting point is p{A*). Since [p] = limt_>.o[p(i)] as 
a linear map defined up to scale, p{A*) C limt_>.o (yi (t) , . . . ,yr{t)), where the limit is taken in 
G(dim A, W). Thus i?Y(p(t)(A*)) < r and KyiM) < ^• 

To see Rx([p]) < Ry(p(^*))) assume Ry(p(^*)) = r and that there exist curves yj{t) C Y, 
such that p{A*) C limt_^o (2/1 (*) > ■ ■ ■ , yr{t)), where again we may assume the dimension of the span 
of the ys{t) is constant for t 7^ and we are taking the limit in the appropriate Grassmannian. 
Let a^, . . . , be a basis of A* . Write p{a^) = lim^^o ^''^{^)ys{t) for some functions c'^{t), so 
p = aj(8)[limt_^o Z^s c-'^(*)2/s(0]- Consider the curve 

p{t) = J2(^j®(^'ii)ys(t) 



®ys{t). 



Thus Rx{\p{t)\) < r for t 7^ and since limt_^o [p(0] = [P\i ^^'^ claim Rx(b]) ^ ^ follows. □ 
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Example 2.5. Let Y = v^iF'^) and X = Seg(¥A x t;3(P^)). Let p = ai^x^ + a2m'^y. Then 
Rx{p) = Ry{p{A*)) = 3 and Rxip) = Ry(p(^*)) = 2. To see Ry(p(A*)) = 2, note that 

p{A*) = lhn{x^{x + tyf)). 

To see Rjf (p) = 2, consider the curve 

P(t) = ^[(^2 + tai)^{x + tyf - a2m\ 

Corollary 2.6. The maximum Tank of an element of Ai® • • • A^, where 

dirndl < • • • < dimAjj, 

is at most dim • • • dim In particular, the maximum rank of an element of (C"*)®" is at 

most mP'~^, compared with the maximum border rank, which is usually ■^^^jiiy^T^ipi ' 
Note that this upper bound is much smaher than the bound in [22, Prop. 5.1]. 



n-l 



3. General facts about rank and border rank of linear spaces 

The following facts are immediate consequences of the definitions of Rx{E),'Rxi^)- 
Proposition 3.1. Let X C W = be a variety of dimension n not contained in a hyperplane, 
let E eG{k,V). Then 

(i) Rx{E) > Rx(-E) > k and ar^^k{X) C ar2,k{X) whenever ri < r2. 

(ii) If X is irreducible and E G ar^kiX) is a general point, then Rx{E) = 'Rx{E)- 

(iii) Rx{E) = k iff {X n ¥E) = FE. In particular, if codimX < k and E intersects X 
transversally then Rx{E) = k and thus ak,k{X) = G{k,N + 1). 

(iv) ar,N-niX) = Gir,N + l). 

(v) For r < N + 1, Rx{E) < r if and only if3F € cr^^ri^) such that E C F and similarly 
Rx(^) < r ffand only if 3F G ar,r{X) such that E C F. 

Proposition 3.2. Let X C FV be a variety of dimension n. If X is not contained in a hy- 
perplane, then 6.\m.ar,r{X) = min{rn, dimG(r, y)}. The expected dimension of ar,s{X) is 
min{rn + s{r — s), dimG(s, V)}. 

Proof. If n + r > dim V, then a general E G G{r, V) is spanned by points of X and thus 

Ur,r{X) = G{r,V). 

Otherwise, if n + r < dim V, then a general collection of r + n points Xi, . . . ,Xr,yi, ■ ■ ■ ,yn 
on X are linearly independent. Let yi{t) now be curves in X such that all the yi to converge to 
xi in such a way that, the limit of the span of a;i, . . . , y„ is the affine tangent space of X at 
[xi]. We see that if our points are chosen generally T\^xi]^ will intersect (x2, . . . ,Xr) only at the 
origin. 

Thus we can choose r points x\, . . . ,Xr & X such that the points are in general linear position 

and also 

(xi, . . .,Xi-i,Xi+i, ...,Xr) nT[^.]X = 

for any i. 

Consider [xi A • • • A x^] G (T,f,f{X). Take a curve xi{t) /\ ■ ■ ■ f\ Xr{t) with Xj{0) = Xj, so 
Xj{Oy G Tjaj^jX. Differentiate at t = to obtain: 

T[xiA-AXr]'^r,r{-^) = 

(Tfj-^jX) A X2 A • • • A + xi A (Tja-jjX) A X3 A • • • A x^ H h xi A • • • A x^-i A (Tj^j^jX). 
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Mod-ing out by xi A • • • A we obtain a direct sum: 

(T[^^]X) Ax2A- • ■AXr®xiA{f[^,^]X)Axs/\- ■ • Ax^©- • -©xi A- • ■ AXr^iA{f[^^,]X) modxi A- • • Ax^. 

This holds because say e.g., v G ,xi A - • ■ A,x,,._i A(Tjj.^]X) were in the span of the other summands. 
Each of the other summands is of the form {stuff) AXr, so v must be of this form as weh, but 
Xr ^ (xi, . . . ,Xr-i). Thus, if X is not contained in a hnear space, dim ar,r{X) = fn. 

We may reahze (T,.^s(X) as the collapsing of a Grassmann bundle over o"r,r(^) in the sense of 
[26]. Namely let S — >■ G{r, V) denote the tautological rank r subspace bundle and let G{s,S) — ^ 
G{r, V) the corresponding Grassmann bundle. There is a natural map from the total space of 
G{s,S) onto G{s,V) and by Proposition 3.1(v), ar,s{X) is the image of G(s,<S)|(^^^(x)- Thus if 
this map is generically finite to one, dimc7r,s(X) = dimar,r{^) + s{r — s). □ 

Corollary 3.3. Let A, W be two vector spaces with dim A < dim W. Consider the rational map 
TT : F{A0 W) — G(dim A,W), with Tr{p) := p{A*) whenever p{A*) has majcimal dimension. 
Then: 

(i) TT is the quotient ofF{A W) by PGL{A). 

(ii) vr is PGL{W) equivariant. 

(iii) for r > dim A and any subvariety Y C ¥W, 

ariWA xY) = 7r-l((7,,dimA(l^))- 

Corollary 3.4. Ifr< dim A < dim W and Y C ¥W is not contained in any hyperplane, then 
ar{Seg{FA x Y)) is of the expected dimension r(dim A + dim Y) — 1. 

Proof. If r = dim A, then by Corollary 3.3(i) and (iii), 

dim {ar{FA x Y)) = dim {ar,r{Y)) + dim PGL{A). 

By Proposition 3.2: 

dim {ar{fA x Y)) = rdim Y + r'^ - 1 = r{r + dim Y) - 1 

as claimed. 

If r < dim A, then (Tj.(P^ x Y) is swept out by smaller secant varieties: 
ar{Seg{FA xY))= [j ar{Seg{FA' x Y)). 

A'cA, dim A'=r 

Since Y is nondegenerate and dim W > r, it follows, that for a general point [p] € ar{Seg(FA x 
Y)) there is a unique linear subspace A' C A oi dimension r such that [p] € P(^' (8> V^). Thus: 

dim {ar{Seg{FA x Y))) = dim G{r,A) + dim (cr,.(PA' x Y)) 

= r(dim A — r) + r(r + dim F) — 1 
= r(dim A + dim y) - 1. 

□ 

In [2], scheme-theoretic methods are used for studying rank. For some varieties X, every 
point on ar{X) is contained in the linear span of a degree r subscheme of X (see [2, Prop. 2.8]). 
For X C ¥V consider the irreducible component of the Hilbert scheme Hilb{X) containing 
schemes, which are r distinct points with reduced structure. Consider the rational map 

^■.Hr-^ G{r,V), 

which sends a subscheme Z C X to its scheme-theoretic linear span. 



6 



J. BUCZYNSKI & J.M. LANDSBERG 



Proposition 3.5. If (p is a regular map, i.e., if each Z & Hr imposes independent conditions to 
linear forms, then for every E G ar^k{X) there exists a 0-dimensional scheme Z C X of degree 
r such that E is contained in the scheme-theoretic span of Z. 

Thus the methods used in [2] may be used to study Seg{¥A x Vdi'P'"')) and its secant varieties. 



4. Situations where ranks and border ranks of points coincide 



Proposition 4.1. Let X C FV be one of (f") (the rank one symmetric (n + 1) x (n + 1) 
matrices), G(2,n) (the rank two skew-symmetric n x n matrices), Seg(¥^ x P^), the Cayley 
plane OP^, or the 10 -dimensional spinor variety S5, (i.e, X is a sub-cominuscule variety, see 
[19]). Then for aU p £ FV, Rx{p) = 

Proof. In all these cases the only orbits are the successive secant varieties, see, e.g., [20]. □ 

A consequence of [5, Thm 2.4.2], which states that for r in the range of the hypotheses in 
Proposition 4.2, Ur{Seg(^Ai x • • • xP^„) = ar(Seg{¥{Ai®- ■ -^PA^.i) xPy4„)), and Proposition 
4.1 is: 

Proposition 4.2. Consider Seg{FAi x • • • x PA„) where dim = a^, 1 < s < n. If an > r > 



^7=1^ - J27=i SH-n + 1, then R^(p) = r implies Rx{p) = r. 



5. Ranks of points in 

5.1. Kronecker's normal form. Kronecker determined a normal form for pencils of matrices, 
i.e., two dimensional linear subspaces of B®C up to the action of GL{B) x GL{C). It is 
convenient to use matrix notation so choose bases of B, C and write the family as sX + tY , 
where X,Y £ B®C and s,t G C. (Kronecker's classification works over arbitrary fields, as does 
J. Ja'Ja's classification of rank, but we only present the results over C.) The result is as follows 
(sec, e.g., [11, Chap. XII]): 
Define the e x (e + 1) matrix 

(s t \ 

Le = Le(s,t) = 



The normal form is 



(5.1) 



sX + tY 



ei 



V 



sldf + tFj 



where F is an / x / matrix in Jordan normal form (one can also use rational canonical form) 
and T denotes the transpose. 

Corollary 5.1. Assume the maximal possible rank of a tensor in C^^C'^^C'^ is r. Then the 

maximal possible rank of a tensor in C'^^C^^C'^'^^ 

• either r or r + 1 if c + 1 > b; 

• either r or r + 1 or r + 2 if c + 1 < b. 



IS 
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Proof. Let sX + ty be a tensor in C'^^C^^C'^'^^ in its Kronecker normal form. If the f x f 
Jordan block F is nontrivial, then we can extract a column of rank 1 (the first column of F) and 
thus write sX -\-tY as a sum of this column and a tensor in C^^C^^C^. Similarly, if sX + tY 
has a nontrivial block of the form Lg., then the first (or the last) column of Lg. has rank 1 as 
well and we can extract it. But assuming c + 1 > b, one cannot have only blocks of the form 
LI^. . Thus one of the situations above must occur. 

In general, we can extract any column, which has rank at most 2. □ 

Say F has Jordan blocks, Fij where Aj is the i-th eigenvalue. If there is no block of the form 
Lg. or L^^, then we may assume at least one of the Aj is zero by changing basis in C^. If the 
blocks Fij are such that there are no I's above the diagonal, then we can normalize one of the 
Aj = 1 by rescaling t. 

For example, say / = 3, the possible normal forms are 




which (again provided there is no block of the form Lg . or L^. ) can respectively be normalized 
to 

(5.2) 1 

Note that when X is / x /, the fourth case is not a pencil. The first case requires explanation 
— we claim that all pencils of the form: 












■1 

















where X, are distinct, are equivalent. In particular, any such is equivalent to one where 
A = 0, jLt = l,i/ = — 1. To prove the claim, first get rid of A by replacing s with si := s + Xt: 













■ 




Ail 











Note that 0, fii and vi are still distinct. Next we replace t with t2 '■= si + tfii: 

Sl\ I + *2 ( 1 

where ;[i2 = 1 — ^ and f2 = — ^ and 0, /X2 and 1^2 arc distinct. Then we transport the constants 
to the first 2 entries by setting S3 := and is := ^^2: 



S3 + *3 



^0 

1^2 



It only remains to change basis in B by sending bi to -^bi and 62 to ^62 to show the pencil is 
equivalent to: 

'I \ /O 

S3 I + is 
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Thus every two such pencils are equivalent. 

If F is 4 X 4 it is no longer possible to normalize away all constants in the case 

/A 1 \ 
A 

/X 1 ■ 

V 

Essentially because of this, the only spaces of tensors C^'S)C^'SiC^, 2 < a < b < c, that 
admit normal forms, i.e., have a finite number of GLa x GLj, x GLc-orbits, are C^^C^^C^ and 
C^(8)C^(XiC*^ (sec [14, 16]). Moreover, in these cases, any tensor lies in a C^(8)C^(8>C^ in the first 
case and a C^^C^^C^ in the second. 

Theorem 5.2 (Ja'Ja'). [12] A pencil of the form (5.1) has rank Y^^i + Y^l^j + f + Q + P + M 
where < M < /i, where jx is the majcimum number of nontrivial Jordan chains associated with 
a given eigenvalue of F. If jj. > 0, then M > 1. 

The idea of the proof is as follows: the normalized blocks are treatable by a direct calculation, 
the only subtle part is to show that one can not have a lower rank for the sum of two blocks 
than the sum of the ranks of each block. The / x / pencil sId + tF has rank f iii F can be 
diagonalized. Most matrices are diagonalizable, so if F is not, a small perturbation of it will 
be diagonalizable. Ja'Ja' shows that each Jordan block can be perturbed to be diagonalizable 
by a rank one matrix. In fact if one selects a rank one matrix at random, with probability one, 
the perturbed Jordan block will be diagonalizable. Ja'Ja' gives a convenient such matrix using 
rational canonical form instead of Jordan canonical form. The inconclusivcncss of the result on 
ranks is because he did not determine if one could perturb by using a higher rank matrix that 
made more than one chain associated to given eigenvalue diagonalizable at once. This actually 
can occur, for example, Theorem 5.4 implies the rank of 





t \ 





s 




s t 


V 


sj 



is five, but each block has rank three. 

Taking into account the various cases Theorem 5.2 implies: 

Corollary 5.3. 

• The maximum possible rank of a tensor in C'^<S>C'^<S>C^ is 3 if c = 2, 3 and 4 otherwise. 

• The maximum possible rank of a tensor in C^(8)C^(8)C*^ is 4 if c = 3, is c if c = 4, 5 and 

is 6 if c > 6. 

• The maximum possible rank of a tensor in C2(g)C■''(g)C^ C^(S)C^(S)C^ or C^^C^^C^ is 7. 

Theorem 5.4. The maximum possible rank of a tensor in C'^^C'^^C^ is 5, and in C^®C^(8>C^ 
is 8. 

Proof. By Corollary 5.3 the maximal possible rank for a tensor in C^(2>C^(8)C^ (respectively, 
C^^C^^^C^) is 4 (respectively, 7). 

Thus by Corollary 5.1, the maximal possible rank for a tensor in C^(8>C^(8>C^ (respectively, 
C^(8)C^(8)C^) is at most 5 (respectively, at most 8). 
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On the other hand, by Theorem 5.2 there are tensors for which the maximum is obtained, for 
example, respectively for C^(8>C^(8)C^ and C^(8>C^(8)C^ one has: 

fs t Q 0\ 
fs t 0\ s t 

s t OOOOsO 
s t OOOOiO' 
\0 00s/ 00000s 
\0 y 

□ 

In general. Theorem 5.2 says there is no tensor in C'^^C^<^C^ of rank [^J +1, but guarantees 
the existence of tensors of rank [^^'^J . 

5.2. Orbits in C^(^C'^^C''. Here and in what follows X = Seg{¥A x¥B x PC). If c = 3 then 
asi^X) = F{A^BCS)C). In the table below we list the representatives of all the orbits of action 
of GL{A) X GL{B) x GL{C) on P(A®S®C). 



orbit closure 


dimension 


Kronecker normal form 


R 




X 


c + 1 


ai(8)6i(8)ci 


1 


1 


Sub221 


c + 3 


a2(8>6i(8)ci + ai(8)62<^ci 


2 


2 


Subi22 


2c + 1 


ai^bi^C2 + ai0b20ci 


2 


2 


Sub2l2 


2c + 1 


ai^biiSiC2 + a2(8)6i(8)ci 


2 


2 


t{X) 


2c + 2 


ai(8)(6i(8)Ci + 62(8)02) + 02061(8)02 


2 


3 


a2{X) = Sub222 


2c + 3 


ai(8>6i(8)ci + 02(8)62(8)02 


2 


2 


x^^ 


3c + 1 


01(8(61 (8ci + 62(803) + 02(862(801 


3 


3 




3c + 2 


01(8(61(801 + 62(802) + 02(8(61(802 + 62(803) 


3 


3 




4c- 1 


01(8(61(801 + 62(803) + 02(8(61(802 + 62(804) 


4 


4 



The first and third are not pencils of matrices. In terms of matrices, the other cases are 

t 



t 



t 



t 

s t 



Geometric explanations: Subijk C ¥{A^B^C) is the set of tensors [p] € FA^B^C such 
that there exists A' C A, B' C B, C' C C respectively of dimensions i,j,k such that p G 
A'^B'(S)C' . In other words, Subijk is the projcctivization of the image of the vector bundle 
SG{i,A)^SG(j,B)(^SG{k,C) ^ G{i,A) X G{j,B) X G{k,C) in A0B(E)C, where Sa^ky) ^ G{k,V) 
is the tautological vector bundle whose fiber over the point E is the linear space E. t{X) is 
the tangential variety to the Segre variety, X^, C F{A*^B*^C*) is the Segre variety in the dual 
projective space and C F{ACS)B®C) is its dual variety. The point of t{X) is tangent to the 
point 01(8628)01, the point of contains the tangent plane to the (c — 3)-parameter family of 

points 03(86^(8(5202 + S2O4 + S2O5 h ScOc), where (op is the dual basis to (oj) of A etc.. The 

dual variety (-^*)^ is degenerate (i.e., not a hypersurface) except when c < 3. 

Note a3{X) = a3{Seg{F{A'SiB) x PC)) which causes it to be degenerate with defect three. 

All these orbits but the last are inherited from the c = 3 case. The last is inherited from the 
c = 4 case. 



5.3. C'^^C^^C^. For future use, let c = 3. First, we inherit all the orbits from the C (8C (8C 
case, i.e., all the orbit closures above except for the last one. They become subvarieties of Sub223 
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with the same normal forms, ranks and border ranks - the new dimensions are as follows: 



orbit 


dimension 


X = Seg{FA xFBx PC) 


c + 2 


Sub221 


c + 4 


Sub2l2 


c + 4 


Subi22 


2c 


r{X) 


2c + 4 


Sub222 = cr2{X) 


2c + 5 


Seg^"^ C Sub223 


3c + 4 


Sub223 


4c + 1 



The new orbit closures are as follows: 



orbit 


dimension 


Kroncckcr normal form 




R 


Subi33 


3c- 1 




ai®(6i(g)ci + b20C2 + bs^cs) 


3 


3 


Seg^'^ C Sub232 


2c + 6 




ai(8)(6i(g)Ci + b30C2) + a2<S)b2^ci 


3 


3 


Sub232 


2c + 7 




ai(g)(6i(g)ci + b2^C2) + a2^{b20ci + b3^C2) 


3 


3 








ai(g)(6i(8)Ci + 62(8)03) + a2(8)(6i(g)C2 + b^^cs) 


3 


4 








ai(g)(6i(8)Ci + 62<S)C2 + b^i^c^) + a2<S)b3^C3 


3 


3 








ai(g){bi^ci + b2<S^C2 + ba^cs) + a2'S>b2^ci 


3 


4 








5(61 (8)ci + 62®C2 + bs^cs) + a2®{b2(S)Ci + 63(8)02) 


3 


4 


Xi^y 


3c + 7 




5(61 (8)Ci + 62(802 + 63(803) + 02(8(62(801 + 63(803) 


3 


4 




3c + 8 




5(61 (8ci + 62(802 + 63(803) + 02(8(62(802 - 63(803) 


3 


3 



The associated / x / matrices, when 3x3, are given by (5.2). Note that the second and third 
cases are not really new. The unnamed orbits are various components of the singular locus of 
X^^ , see [16] for descriptions. 

Seg^,^ C Sub223 is the subvariety of Sub223, obtained from the sub-fiber bundle of 
^G{2,A)^^G{2,b)'^Sg(3^C)7 whose fiber in A'^B'^C' (where dim^' = dimS' = 2, dimC" = 3) is 
Seg{¥A'* x ¥B'* x ¥C'*y C A'^B'^C. 

5.4. C^(g)C^(g)C'^. Wc have all the orbits in C^(g)C^(g)C^ , which arc all contained in Sub233 and 
thus should be re-labeled as such, the last one becomes Sub233, their dimensions are given in 
the above charts by setting c = 4. The new orbit closures are: 



orl)i( 


dimension 


iKn'nial form 


E 


i2 


Sub224 


4c -h 1 




ai(8(6i(8ci + 62(803) -1- 02(8(61(802 + 62(804) 


4 


4 








5(61(801 + 62(802 + 63(804) + O28)(6i(802 + 62(803) 


4 


4 








01(8(61(801 -1- 628)03 + 638)04) -1- 02(861(802 


4 


4 








5(61(801 -1- 62(803 -1- 63(804) + 02(8(61(802 + 62(804) 


4 


4 




10c - 18 


ai(J 


$(6i(8ci + 62(803 + 63(804) + 02(8(61(802 + 62(803) 


4 


4 


P(A(85(8C) 


6c- 1 


ai(8(6iC 


801 + 62(802 + 63(803) -1- 02(8(61(802 + 62(803 -1- 63(804) 


4 


4 



The unlabeled orbit closures are various components of {X^'^)sk 



5.5. C2(8C3(8C'=. We have all the orbits in C^(S)C^^C'^, which are all contained in Sub23A and 
thus should be re-labeled as such, the last one becomes Sub234, plus: 
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orbit 


dimension 


normal form 


R 


i? 


x^y 


5c + 2 


ai(8)(6i(8)ci + 62<8)C4 + 63(8)05) + a2(8)(6i(8)C2 + 62<8'C4) 


4 


5 


Sub235 = cr5{X) 


5c + 4 


ai<8)(6i(Xici + 62<8)C2 + b^^c^) + 02(81(61 (X)C2 + 62(8)04 + 63(805) 


5 


5 


F{A(^B(g)C) 


6c - 1 


ai(8'(6i(8ci + 62(8103 + 65(8)05) + 02(81(61(8)02 + 62(8)04 + 63(805) 


6 


6 



When c = 5, 5^x6235 = P(A(8)-B(8C) and the last normal form does not occur. 



6. Application to X = Seg{FA x V2{FW)) C F{A(g)S'^W) 

This case is closely related to the determination of ranks of tensors with symmetric matrix 
slices, an often-studied case in applications, see, e.g., [25] and the references therein. (If the 
generalized Comon conjecture (see, e.g., [3]) is true here, this case is the same as the case of 
tensor rank of partially symmetric tensors.) 

This case is easier than that of Seg(¥A x ¥W x FW) because a symmetric matrix is always 
diagonalizable. 

Case a = 2. Assume without loss of generality that p{A*) <f_ S'^W for some linear space 
W C W ^ and that the image is two-dimensional. If there is an element of maximal rank in 
p(^*), then Rx{p) = dim W, because the second matrix must be diagonalizable. 

On the other hand, pencils of symmetric matrices of bounded rank can be classified by the 
Kronecker normal form: just take something of the normal form (5.1) where p = q and ej = r]j, 
and permute the rows and columns so that it becomes a symmetric matrix. We conclude: 

Theorem 6.1. Let X = Seg{F^ x U2(P"-^)) C F{A^S^W). Let p G A^S'^W, and let p{A*) 
have Kronecker normal form with indices q,f, and €j, so n = dimW = 2ej + /. Then 
Rx{p) = n + 2q. In particular, the maximum X-rank of an element ofC^^S^C" is [^J. 

7. Ranks and normal forms in a3{Seg(FAi0 • • • (8) FAn))) 
We assume throughout this section that ra > 3. 

Recall that for any smooth variety X, if x G a2{X), then either x E X , x E a2{X) or x lies 
on an embedded tangent line to X. 

7.1. a2{Seg{FAi^---^FAn))) case. 

Theorem 7.1. Let X = Seg(FAiiSi • • • (8 FAn) C F{Ai^ ■ ■ ■ (8 An) be a Segre variety. There is 

a normal form for points x G a2{X): x = aQ(8) • • • (8 Qq ^ point of X, x = • • • (8 Oq + 
a{(8' • • • (8) a" for a point on a secant line to X (where for this normal form, we don't require all 
the a\ to be independent of the Qq), and have ranks 1,2, and for each J C [n], \J\ > 2, the 
normal form 

(7.1) X = al® ■ ■ ■ <8 Qo + XI "0® ■ ■ ■ <^ a(;~^i^afmo^^0 ■ ■ ■ (8 

jieJ 

which has rank \J\. In particular, all ranks from 1 to n occur for elements of a2{X). 

Proof. All the assertions except for the rank of x in (7.1) are immediate. The rank of x is at 
most I J| because there are \J\ + 1 terms in the summation but the first can be absorbed into 

any of the others (e.g. using Oq + a{' instead of a-'^). 

Assume WLOG \J\ = n and work by induction. First say ra = 3, then Corollary 5.3 establishes 
this base case. 
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Now assume we have established the result up to n — 1, and consider the x{Al). It is spanned 

by 

ao<8) • • • (8) , ^ ao<8) • • • (8) al~^ <Sia{<Sial'^^ <Si • • • Oq . 
j 

By induction, the second vector has rank n — 1. It remains to show that there is no expression 
of the second vector as a sum of n — 1 decomposable tensors where one of terms is a multiple 
of Oq® • • • (g) Oq . Say there were, where ag® • • • (8) Oq appeared with coefficient A, then the tensor 
J2j o'o'^ • • • (8> ai~^ 'S>a{'S>ap~^ iS) ■ ■ ■ 'S> Oq — Aoq® ■ ■ ■ ^ would have rank n — 2, but setting af = 
of — Aq and d\ = a-[ for j G {3, . . . , n}, this would imply that 

ao<8) • • • (8) a;j"-^(g)aj(g)a;j+^(8) • • • <8) 

had rank n — 2, a contradiction. □ 

7.2. Case of a3{Seg{FAi<^ • • • (g) PA„))). Let 

X e a3{Seg(¥Ai<S) • • • (8) ¥An))\a2{Seg{¥Ai® • • • PA„)). 

The standard types of points are: a point on an honest secant (which has rank 3), a point 

on the plane spanned by a point of the Segre and a tangent to the Segre, which has rank at 
most n + 1, and a point of the form y + y' + y" where y{t) is a curve on Seg{FAii^ • • • (8> P^n)- 
The latter type of point has rank at most ("2 ^) because a generic such point is of the form 

Oq® • • • (8 + ^ flo® • • • (8) 4"^8)a{(84"^^(8) • • • 
j 

+ X] "o'8> • • • ® ai~^'^a{'^ai'^^iSi • • • (8 ao"^(8)ai(8)ao"^^(8 • • • (8) Oq 
+ X] '^o® • • • (8) a;j~-^(84(8a;j"''^(8) • • • <8 

The first term and second set can be folded into the last term, giving the estimate. One can 
show that the above types of points exhaust the possibilities for a2{Seg{VAi^ • • • (8 PA„))). 

Proposition 7.1. The rank of the 3 plane given by 

C2 ci Co\ 

ci Co 
Co 0/ 

is 5. 

Proof. We first show the rank is at most 5, by noting that the rank of 

ci co\ 
ci Co 
Co 0/ 

is at most 4 by Corollary 5.3 and the rank of 

C2 0\ 


0/ 

is one. 
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To see the rank is at least five, were it four, we would be able to find constants a, /3, si,S2, S3, ti,t2, t^, 
such that the rank of 

1 0\ /Sih Sit2 Sit-A 

a 1 + 52*1 •52*2 52*3 
Pal) \S3*i 53*2 53*3/ 

is one. There are two cases: if s\ 7^ 0, then we can subtract times the first row from the 
second, and times the first row from the third to obtain 

(1 + Si*i Si*2 Si*3 
* 1 

* * 1 

which has rank at least two. If si = the matrix already visibly has rank at least two. □ 

Corollary 7.2. The rank of a point of az{Segi^A x PS x PC)) of the form y + y' + y" is 5. 

Moreover, the maximum rank of any point of as{Seg(FA x ¥B x PC)) is 5. 

Remark 7.3. Corollary 7.2 seems to have been a "folklore" theorem in the tensor literature. 
For example, in [15], Table 3.2 the result is stated and refers to [17], but in that paper the 
result is stated and a paper that never appeared is referred to. Also, there appear to have been 
privately circulating proofs, one due to R. Rocci from 1993 has been shown to us. We thank M. 

Mohclkamp for these historical remarks. 

Starting with ai{Seg{FAi(Si • • • (S" PA„))) there are exceptional limit points and these points 
turn out to be important - they are used in Schonhage's approximate algorithm to multiply 3x3 
matrices using 21 multiplications, see [3]. 
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